Informed Source Separation of Orchestra and Soloist
نویسندگان
چکیده
A novel technique of unmasking to repair the degradation in sources separated by spectrogram masking is proposed. Our approach is based on explicit knowledge of the musical audio at note level from a score-audio alignment, which we termed Informed Source Separation (ISS). Such knowledge allows the spectrogram energy to be decomposed into note-based models. We assume that a spectrogram mask for the solo is obtained and focus on the problem of repairing audio resulting from applying the mask. We evaluate the spectrogram as well as the harmonic structure of the music. We either search for unmasked (orchestra) partials of the orchestra to be transposed onto a masked (solo) region or reshape a solo partial with phase and amplitude imputed from unmasked regions. We describe a Kalman smoothing technique to decouple the phase and amplitude of a musical partial that enables the modification to the spectrogram. Audio examples from a piano concerto are available for evaluation.
منابع مشابه
Informed source separation of orchestra and soloist using masking and unmasking
A novel technique of unmasking to repair the degradation in sources separated by spectrogram masking is proposed. Our approach is based on explicit knowledge of the musical audio at note level from a score-audio alignment, which we termed Informed Source Separation (ISS). Such knowledge allows the spectrogram energy to be decomposed into note-based models. We assume that a spectrogram mask for ...
متن کاملProduction, convention and power: Constructing the sound of an Early Music orchestra
By explaining how an Early Music orchestra produces its sound, we can review Howard Becker’s concept of a convention. An orchestra’s sound depends on principles incorporated in things (musical instruments, scores) and bodies (musicians’ techniques). A common set of principles about interpret-ing a piece of music — principles acquired well before any rehearsal — do not suffice for coordinat-ing ...
متن کاملSource Separation By Score Synthesis
A musical score provides a great deal of information about a piece of music. In this paper we consider the incorporation of a music score to guide source separation on a single channel recording. We propose a method based on synthesizing lines of music in the score. Dynamic time warping (DTW) is used to to fit the synthesized data to the recording. These are then used as prior distributions in ...
متن کاملReal - Time Pitch Detection
Finally, there is a definition problem between monophonic and polyphonic sounds. In the case of monophonic sound, the obvious definition is to pick the lowest partial as the fundamental frequency. In the case of polyphonic sounds, resulting either from one source (e.g., a piano) or from many sources (e.g., orchestra, choir), the definition is far more difficult, and approaches close to the prob...
متن کامل30349_ MEI Journal
The Hyperinstruments research group at the MIT Media Lab in Cambridge, Massachusetts, USA. developed a number of technology-based instruments and a piece of graphical software for composition for children in the 8-12 year age range. The ‘Toy Symphony’ project gave children in various cities in Europe and the USA access to these technologies during a series of workshops and culminated in a publi...
متن کامل